Winning quick and dirty: the greedy random walk 
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As a strategy to complete games quickly, we investigate one-dimensional random walks where the 
step length increases deterministically upon each return to the origin. When the step length after 
the k^^ return equals k, the displacement of the walk x grows linearly in time. Asymptotically, the 
probability distribution of displacements is a purely exponentially decaying function of \x\/t. The 
probability E{t, L) for the walk to escape a bounded domain of size L at time t decays algebraically 
in the long time limit, E{t,L) ~ L/t'^. Consequently, the mean escape time (t) ~ LlnL, while 
{t") ~ L^"^^ for n > 1. Corresponding results are derived when the step length after the fc**^ return 
scales as k" for a > 0. 

PACS numbers: 02.50.-r, 05.40.-a 



I. INTRODUCTION 

A popular card game for young children is "war" . The 
rules of this game are extremely simple: with two players, 
start by dividing the cards evenly between the players. At 
each play, the players expose the top card in their piles. 
The person with the higher card collects the two exposed 
cards and incorporates them into his or her pile. When 
there is a tie, a "war" ensues. Each player contributes 
three additional cards from his or her pile to the pot and 
then the fourth card is exposed. The winner takes the 
pot. In case of another tie, the war is repeated until there 
is a winner. The game ends when one player no longer 
has any cards. 

Similar to many other games including for example, 
coin toss, roulette, and dreidel, the game of war resem- 
bles a random walk P, 0) 0' ^ the number of cards 
possessed by each player changes by ±1 (or by ±5, ±9, 
etc., when occasional wars occur) after each play. Since 
there are TV = 52 cards in a deck, a natural anticipation 
is that the length of the game scales as 0, Q . Based 
on soporific experiences in playing war with our children, 
it is desirable to modify the rules so that the game ends 
more quickly. We have found that the following modifi- 
cation - which we term "superwar" - works quite well: 
in each war, increase the number of cards that a player 
contributes to the pot by one compared to the previous 
war. This modification of war ends much more quickly 
than the original game and is also more exciting for young 
children. 

The game of superwar inspires the present work in 
which we investigate the properties of a one-dimensional 
random walk in which the step length increases in a deter- 
ministic manner each time the walk returns to the origin. 
We term this process the Greedy Random Walk. More 
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generally, we consider the situation where the step length 
ik after the k^^ return to the origin is 

4 = k", (1) 

with positive a; the initial step length equals one. The in- 
creasing step length corresponds to increasing the payoff 
when the cumulative score of a game is tied. This mech- 
anism provides a strategy to complete games quickly, al- 
though it differs than superwar where the payoff is raised 
when there is a tie in a single play. 

In the next section, we give heuristic arguments for the 
typical displacement and for extremal properties of the 
probability distribution. Then we study the probabil- 
ity distribution of the greedy walk in an infinite system. 
We present simulation results as well as an asymptotic 
solution for this distribution. Our solution relies heav- 
ily on classic first-passage properties of random walks 
[a, S B • The probability distribution of the greedy 
random walk has several intriguing non-scaling features, 
including sharp valleys at the prime numbers and an 
anomalous contribution due to walks that never return 
to the origin. 

In Sec. Ill, we determine how long it take for a greedy 
walk to escape the finite interval [—L,L]. Generically, 
the escape time grows more slowly than the diffusive time 
scale L^/D. As a consequence, the game ends much more 
quickly. However, the escape probability has a power- 
law tail so that the higher moments are controlled by the 
diffusive time scale. Thus the escape time of the greedy 
walk are characterized by large fluctuations. 

II. DISPLACEMENT STATISTICS 

A. Typical and Extremal Displacements 

We first determine the typical displacement of the 
greedy random walk. A crucial fact is that the statistics 
of returns to the origin arc not affected by the growth of 
the step length. Thus, a typical walk of t steps will visit 
the origin of the order of fc ^ t-^^^ times Thus, 
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the step length £ = k" grows as t"/^. For an ordinary 
random walk with step length i, the typical displacement 
is X '--^ t^/^i. Combining these two scaling laws, the typ- 
ical displacement of the greedy walk grows with time as 

X ^ (2) 

with v ^ (I + a) 12. Thus the greedy walk is more ex- 
tended than a conventional random walk. 

We expect that this typical displacement characterizes 
the probability distribution that the greedy walk is at 
position X at time i, G{x,t). In the long time limit, 
this distribution should thus conform to the conventional 
scaling form 

G(x,t)~i-''$(a; (3) 

where is the scaling function. 

We can determine the asymptotic decay of <I>(z) by us- 
ing a Lifshitz tail argument pJ]llllj|. As a preliminary, we 
need to identify the walks with the maximal possible dis- 
placement. For conventional random walks, the extremal 
walk is ballistic - stepping in one direction only. For the 
greedy random walk, in contrast, extremal walks involve 
a compromise between returning to the origin often, so 
as to acquire a large single-step length, and moving in 
one direction, so as to be as far from the origin as possi- 
ble. We are thus led to consider a hybrid zig-zag/ballistic 
walk that makes immediate reversals for the first r steps 
and then moves in one direction for the remaining t — t 
steps. 




FIG. 1: Extremal greedy walk of 16 steps when the step length 
grows linearly at each return to the origin. There are 4 im- 
mediate reversals in the first 8 steps and then the remaining 
steps are all in one direction. 

When only immediate reversals in direction occur, the 
step length after r steps (r/2 returns) is £t/2 = {t/2)°'. 
Then if the remaining steps are all in one direction, the 
displacement of the walk at time t is 

x={t-T)[^y. (4) 

Maximizing this expression with respect to r, the opti- 
mum value of r is T = t and the maximal displace- 
ment is 

(5) 

Notice that the exponent characterizing the maximal 
displacement is twice that of the typical displacement. 



We now exploit the result for Xmax to estimate the 
tail of the probability distribution. We first make 
the standard assumption that the tail of the proba- 
bility distribution decays as a stretched exponential, 
$(z) - exp (-|z|*), for z » 1 [13, where all factors of 
order one have been ignored. With this ansatz, the prob- 
ability for the maximal-displacement greedy walk asymp- 
totically scales as 

G(2; = t2^,t)-exp(-i''*). (6) 

On the other hand, the probability for this maximal- 
displacement walk decays exponentially with time, since 
a finite fraction of the steps in the walk must be uniquely 
specified. Equating this exponential decay to the form 
given in Eq. ((^, we immediately conclude that 5 = 
As a result, we deduce that the scaling function in G{x, t) 
decays according to 

<I)(z)^exp(-|z|2/(i+")), (7) 

for z ^ 1. Notice that the conventional Fisher scaling 
relation 5 — [\ — is violated for greedy walks ,1QJ. 

B. The Probability Distribution 

We can obtain the full probability distribution of 
greedy walks by utilizing basic first-passage properties of 
ordinary random-walks. These first-passage techniques 
provide an insightful and pleasant way to understand 
greedy walks. There are two generic ways that the greedy 
walk can be at position x at time t when starting at the 
origin at t = 0. The first is to reach x without ever re- 
turning to the origin. The second possibility, as depicted 
in Fig. 13 is that the walk returns to the origin k times, 
with the k^^ return occurring at time t, and then the walk 
reaches x in the remaining t ~ t steps without touching 
the origin again. The number of returns to the origin is 
variable, but the maximum number cannot exceed t/2. 




FIG. 2: Space-time trajectory of an example greedy random 
walk, with 4 returns to the origin after r steps. Upon each 
return, the step length increases, as indicated schematically. 
After the last return, the final position is reached in the re- 
maining t — T steps. 

According to this decomposition of a greedy walk into a 
segment that consists of k returns to the origin and a non- 
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return segment, we can write the probability distribution 
of greedy walks in the following form: 



fc=l 

(8) 

Here fcmax is the maximum possible number of returns 
to the origin in time t when the final displacement is x. 
The first term on the right is the probability that a walk, 
which never returns to the origin, is at x at time t. In the 
second term, F('°)(0,t) is the fc^'^-passage probability to 
the origin, namely, the probability that the walk returns 
to the origin k times, with the k^^ return occurring at 
time T. The term -^Q {-^,t~ r) then accounts for the 
probability for the walk to reach x in the remaining t — r 
steps without touching the origin again. Because the step 
length is k°' in this last leg of the walk, x/fc" steps are 
required to reach x. We also need to include the prefactor 
to ensure proper normalization. 
Since Eq. (jSJ is in the form of a convolution, it is much 
more convenient to work with Laplace transforms. Then 
the basic equation for the probability distribution sim- 
plifies to 



fcmax , 

G(x, s) = Q(x, s)+J2 F^'^ (0, s) -Q (^, .) 



(9) 



where the argument s is generally used to signify Laplace 
transformed quantities. Each of the terms on the right- 
hand side of this equation are well known first-passage 
properties (fl, Li iSj liBj i from which we can then obtain the 
probability distribution of greedy walks. 

We now determine the individual terms that appear in 
Eq. jnj. The non- return probability Q{x,t) is the prob- 
ability that a random walk, that starts at a;o = 1, is at 
position X at time t, and that the origin is never visited. 
In the t oo limit, this quantity satisfies the diffusion 
equation Qt = DQ^x subject to the absorbing bound- 
ary condition Q{x = 0,t) — 0. This boundary condition 
ensures that only walks that do not hit the origin are 
counted. It is simple to construct Q{x, t) by the im- 
age method. We merely place a random walk of oppo- 
site "charge" at —xq] this construction ensures that the 
boundary condition at a; = is automatically satisfied. 
In the continuum limit, we have 



g(x,t) 



I 



x 



^-(x-xaY /ADt _ ^-(x+xoY/iDt 



^-x^/iDt 



(10) 



with xo ^ 1. The Laplace transform of this distribution 
is s) = ZJ-ig-l^lVV^ [l2]. 

In a similar vein, the fc"^-passage probability to the 
origin at time t is the convolution of a product of 
k first-passage probabilities at times ti < t2 < ■ ■ ■ < tk- 
Correspondingly, the Laplace transform for this fc**^- 
passage probability is then the product of k first-passage 



probabilities. In turn, the first-passage probability 
to the origin is simply F{0,s) = 1— [P{0,s)]~^, where 
P(0, s) — l/\/4sD is the Laplace transform of the occu- 
pation probability at the origin 0, 01 • This connection 
between the first-passage and occupation probabilities 
is perhaps the most fundamental result in first-passage 
statistics. Thus the Laplace transform of the fc*^-passage 
probability to the origin has the compact form ^ .13l| : 



F'^'^^x = 0,s) ^ e 



-kViDs 



(11) 



Substituting these results in Eq. lO, the Laplace trans- 
form for the probability distribution of the greedy ran- 
dom walk is 



G{x,s) ~ 



1 

k°' 



(12) 



Here we drop the first term Q{x,s) in Eq. ^ because it 
gives a subdominant contribution to G{x, s). To simplify 
the derivations that follow, the diffusion coefficient is set 
equal to one and all numerical prefactors of order one are 
ignored. We perform the sum over k by first taking the 
continuum limit and then using the Laplace method. The 
integrand has a maximum at k* oc We then 

expand the exponent function /(fc) — —^/s(k + |a;|/fc") 
to second order about this maximum and perform the 
resulting Gaussian integral. This gives 

Gix, S) CX s-l/4|2.|(l-2a)/2(a + l) (^^^l/S |^| Vd+a) ) . 

Finally, we invert the Laplace transform by the Laplace 
method to obtain, after straightforward steps, the prob- 
ability distribution as a function of time 



G{x,t) 



a; 1+° 



■ exp 



(_|2;|2/(l+")t-lj . (13) 



Using the definition the scaling function underlying 
the probability distribution function G{x,t) is 



$(z) ^ \z\ 1+° exp (~\z 



|2/(l+a) 



(14) 



Notice that for the particular case of a = 1 , the proba- 
bility distribution is a pure exponential decay in z. 

There are several features of this probability distribu- 
tion worth emphasizing. First, it is straightforward to 
compute moments of the displacement from (I12II . Thus, 
for example, we have (with the diffusion coefficient re- 
stored) 



(x'it)) 



ir(l + 2a) 
2 r(2 + a) 



(15) 



Notice that in the case of a = 1 , the displacement of the 
greedy walk is independent of the diffusion coefRcient. 
Second, for any non-zero value of a < 1, no matter how 
small, greedy walks are eventually repelled from the ori- 
gin. Third, the limit a ^ is singular. This is reflected 
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FIG. 3: Probability distribution of the greedy random walk 
after t = 10^ steps. Shown are results for integer-valued step 
lengths (solid line) and continuum step lengths (dashed line) . 
The latter distribution was scaled up by a factor 2. The inset 
shows detail of the prime-based fluctuations. 

in the limiting behavior of Eq. (|14|l . ^{z) ~ |z|, when 
z ^ 0. In contrast, the probability distribution of an or- 
dinary random walk is finite at the origin. Finally, note 
that the cumulative distribution C{x, t) = '^^/^^ G{x' , t) 
has the scaling form C{x,t) — > $(7(0; t^"), with the sim- 
pler scaling function 

$cW^exp(-|z|2/(i+")) . (16) 

There is no algebraic prefactor in the cumulative distri- 
bution, and the scaling function is finite at the origin, as 
it must. 

C. Simulations 

To test our predictions for the typical displacement 
and the probability distribution, we turn to simulations. 
For concreteness we examined only the case of a = 1, 
where the step length increases linearly in the number of 
returns to the origin (see Eq. Our data are all based 
on averaging over 10^ walks. As a preliminary, we veri- 
fied that the root-mean-square (rms) displacement Xmis 
grows linearly with time in accordance with Eq. H15|) . 

The probability distribution itself exhibits several in- 
triguing features that lie outside of a scaling description 
(Fig. |3J. First, there are huge fluctuations in the distri- 
bution. These arise because displacement values that are 
prime or have relatively few prime factors are hard to 
reach by a greedy random walk. While this variability in 
the distribution is striking, it does not play a role in the 
asymptotic scaling form of the distribution. 

There is also a singularity at a; = and secondary 
peaks at a distance i^/^ from the origin. The singular- 




-8 -6 -4 -2 2 4 6 8 



z 

FIG. 4: The scaling function of Eq. @ for walks with 10^ 
and 10^ steps on a semi-logarithmic scale. Also shown as a 
reference is an exponential distribution. The distributions are 
normalized to have a unit rms displacement, {z'^) — 1. 



ity arises because the probability of being exactly at the 
origin is not affected by the enhancement mechanism of 
greedy walks. All that is required is an equal number 
of steps to the left and right, independent of when these 
steps occur. Thus the amplitude of this peak decays as 
t~^/^, as in a pure random walk. In contrast, as follows 
from H13|) , the amplitude of the scaling part of the distri- 
bution scales as t~^. 

To visualize the envelope of the distribution and the 
anomalous behavior near the origin more clearly, we in- 
troduce a smoothed version of the greedy random walk 
in which the step length grows by an increment that is 
uniformly distributed between and 2 upon each return 
to the origin. Such a construction still has a step length 
that equals, on average, the number of returns to the 
origin, but there are no longer any discreteness effects 
(Fig. |3Jl. The resulting probability distribution clearly 
reveals secondary peaks close to the origin. These are 
due to walks that never return to the origin. For this 
class of walks, the contribution to the probability dis- 
tribution in the continuum limit was given by Eq. I|1(J|) . 
Since the characteristic length scale of this contribution 
is proportional to t^^^, the secondary peaks get squeezed 
toward the origin when the distribution is plotted against 
the properly scaled coordinate x/t. 

More importantly, the continuum probability distribu- 
tion of the greedy walk obeys scaling, with the scaling 
function a purely exponential function of the normalized 
displacement z = x/xrms, in agreement with our analytic 
prediction given in Eq. H14|l . 
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FIG. 5: The scaling function of the exit-time distribution 
(Eq. 11811 ') from simulations with system size L = 10^ (solid 
line), L = 10^ (dashed line), and L = lO" (dotted line). 



III. DURATION STATISTICS 

We now turn to the question that motivated this work, 
namely, how long does a game that is based on a greedy 
random walk last? More abstractly, how long does it 
take for a greedy random walk to escape the interval 
[— i, L]? Our basic result is that the typical escape time 
is relatively short, but higher moments still involve the 
diffusive time scale L^. 

The displacement scaling law (jJJ suggests that the typ- 
ical escape time scales as 

t - (17) 

with /i — l/v — 2/{a + 1). The exit-time distribution, 
E(t,L), namely, the probability that the walk exits a 
system of size L at time t, should then follow scaling in 
the large-L limit (Fig. (SJ 

E{t,L) ^ L-'''^/ {tL->') . (18) 

Since /i < 2, the typical lifetime of a walk is shortened 
by the greedy walk mechanism. 

The minimal escape time is realized by hybrid zig- 
zag/ballistic walks that have the maximal displacement. 
Similar to the considerations leading to Eq. I^J, the es- 
cape time for such extremal walks is t — t + L{t/2)~°', 
with T the duration of the zig-zag phase. The escape time 
is minimized when r ~ L^/'^'^ ~ L^/^ and the minimal 
escape time also scales as L'^/^ . Since the probability for 
such walks decays exponentially with the escape time, we 
then infer from Eq. (|18|1 . the asymptotic behavior 

*(y) ~ exp(-l/y), (19) 




y 

FIG. 6: The scaling function of the exit-time distribution on 
a double logarithmic scale. 

for y <C 1. This scaling is independent of a and thus, 
is identical to that of an ordinary random walk. We 
conclude that short-lived games are relatively rare. 

Long-lived walks are more interesting. To determine 
the likelihood of such walks, we need to understand 
greedy random walk trajectories (Fig. in finer detail. 
First consider the return segments of the greedy walk. 
Upon the j"^ return and after the next step, the walk is 
at ±j". Then from classic first-passage properties 
the probability of returning again to the origin without 
escaping is (1 — j" /L), while the probability of escaping 
without another return is j" /L. Notice that the increase 
of the single-step length effectively reduces the system 
size by the step length. Using these results, the proba- 
bility of returning to the origin at least k times is 

~ exp{-k^+"/L) . (20) 

The typical number of returns to the origin before escape 
occurs is found from the criterion Rk « 1/2; this gives 

This statement tell us the magnitude of the typical payoff 
in a greedy random walk-based game. 

For a greedy walk to escape the system at time i, 
there may be A: > returns to the origin, followed by 
a non- return segment. From Eq. (|2()(l . the probability 
for the former event is exp (— fc^^"/L). In the long-time 
limit, the probability for the non-return segment scales 
as (4r)^ exp (— where, as usual, we have ig- 
nored all factors of order one in the exponential. The 
exponential term is just the controlling factor for the es- 
cape probability of a random walk in an interval of length 
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L/k°' [g. The prefactor (k^/L)^ ensures that the inte- 
gral of this factor over all time gives the correct ultimate 
escape probability of k^/L. Putting these elements to- 
gether, the probability E{t, L) for a greedy walk to escape 
the interval [—L,L\ at time t is 



E{t,L) 



k=l 



(21) 



By converting the sum to an integral, and noting that 
in the long time limit, the last term is negligible, we 
obtain 



E{t,L) 



^3/2+1/2 



(22) 



over the intermediate time range <^ LF' . Escape 

times larger that are realized by walks that never re- 
turn to the origin. However, such walks are exponentially 
unlikely, exp(— t/L^), so that their contribution is irrel- 
evant in the scaling limit. In the limit a — s- oo, walks 
may return to the origin at most once, and the behavior 
E{t, L) ^ t~^l'^ follows from Eq. ifTUIl . Finally, the power- 
law form of E{t, L) implies that the scaling function has 
the power-law decay for y ^ 1 (Fig. O 



(23) 



The existence of this power-law tail suggests that 
higher-order moments of the distribution are not char- 
acterized by the typical behavior (|17|l . By integrating 
Eq. H22|) up to the time scale , we find three behaviors 



LlnL n = TLc 



(24) 



-2ji-l 



n > Tic 



Low-order moments are characterized by the typical es- 
cape time, while high-order moments are described by 
pure diffusion. At the boundary Uc ^ {a + l)/2a, there 
is a logarithmic correction. Thus while the greedy walk 
mechanism significantly reduces the typical duration of 
the game, there are substantial fluctuations in this dura- 
tion. In the worst case, the duration would be propor- 
tional to L^, as in the ordinary random walk. 

When the step length grows linearly with the number 
of returns to the origin, Eq. (|22|l shows that the exit time 
distribution has the asymptotic behavior L/t'^. Thus the 
average lifetime of a greedy walk includes the logarithmic 
correction 



(t) cx LlnL. 



(25) 



This behavior can be obtained directly by noticing that: 
(i) there are of the order k ^ L^/^ returns, (ii) the average 
fc*'' return time is {tk) (x L + L/2 + ■ ■ ■ L/k (x Link. 

For completeness, we mention that the full survival 
probability can be computed via the Laplace transform. 
For an ordinary random walk starting at x = 1 in a 
domain of length L with absorbing boundary conditions, 



the Laplace transform of the first-passage probabilities 
at X = and x = L are, respectively 0, 



J- 



-(s) = smh[yQD{L-l)]/smh[^/7/DL] 



j+{s) = sinh[v/^]/sinh[v/^i]. 

The first-passage probability at x — L for the greedy 
random walk is obtained by summing over the possible 
number of returns and scaling down the domain size by 
the step length Ik at each return. This gives 



E{.s,L) 



OO 

E 



sinh ^ 



sinh 



n 



1 



I'd sinli[yi^] f \ sinh[Vi^] 



(26) 



The small-time and large-time behaviors given above fol- 
low from the large-s and small-s behaviors of this expres- 
sion, respectively. Additionally, the fc-th return probabil- 
ity given in Eq. (|20|l equals the s ^ limit of the product 
in Eq. 



IV. SUMMARY 

The greedy random walk, in which the step length in- 
creases algebraically with the number of returns to the 
origin, exhibits a variety of unusual features. The distri- 
bution of displacements is non-Gaussian, despite the fact 
that each epoch is characterized by a Gaussian distribu- 
tion. Similarly, the distribution of escape times decays 
as a power-law tail even though each segment has an or- 
dinary exponential decay. 

The most extended walks follow a two-stage process 
of immediate reversals followed by a ballistic trajectory. 
There are also several features of the probability distri- 
bution that are outside of scaling, including the contri- 
butions of walks that never return to the origin, walks 
that are exactly at the origin, and large prime-number- 
induced fluctuations. 

The time for a greedy random walk to escape a finite 
interval is much smaller than that of ordinary random 
walks. However, because the distribution of escape times 
decays as a power law in the long time limit, there are 
large fluctuations in the escape time and the longest pos- 
sible games have a similar length to those based on ordi- 
nary random walks. 

We conclude that the greedy random walk provides a 
strategy for completing zero-sum games quickly. Increas- 
ing the stakes when the game is tied accelerates the path 
to richness or to ruin. 
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